ED 283 847 TU 870 364 

AUTHOR Proller, Hormmn L. 

TITLE Evaluation of the 1984-85 ECIA, Chapter IZ Legal 

Project* 

INSTITUTION Dade County Public Schools, Miami, FL. Office of 

Educational Accountability* 
PUB DAT£ Jun 85 

NOTE 2Qp. 

PUB TFPE Reports - Research/Technical (143) — 

Testi/Evaluation Instrwents (160 ) 

EDRS PRICE ICPOl/PCOl Plus Postage, 

DESCRIPTORS *Inservice Teacher Education; ^Instructional 

Materials; *Law Related Education; ^Program 
Attitudes; ^Program Evaluation; Questionnaires; 
Resource Staff; School Districts; Secondary 
Education; Student Attitudes 

IDENTIFIERS Dade County Public Schools FL; Education 

Consolidation Improvement Act Chapter 2 



ABSTRACT 

The Legal Education Goals and Learning (LEGAL) 
project in the Dade County Public Schools, Florida, is an elective 
course for students in grades 7-12. Because eMtenslve annual 
evaluations of this project since 1976 had been eKtremely favorable, 
the size and scope of the 1984''8S evaluation was reduced. It 
inviistigated the extent to which LEGAL achieved its primary goals in 
schools offering LEGAL courses for the first time. Ten social studies 
teachers and 10 percent of approMlmately 700 students enrolled In the 
new fall semester LEGAL courses were mailed questionnaires to obtain 
their views on LEGAL -s support services, In-servlce training, and 
currlculmn» Results showed that LE6AL teachers highly favored the 
provision of instructional support services. Among the students, 32 
percent thought the quality of material's was better t^ an that 
employed in other courses, 53 percent thought the quality was about 
the same, 49 percent Indicated that the outside resources were ulmo 
better. In regard to the provision of in-service training, 71 percent 
of the teachers believed they had received adequate training, though 
86 percent wanted more training. The questionnaires, with results, 
are appended, (JAZ) 
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Introduction 



The 1984-85 LEGAL (Law Education Goals and Laarta Pruj iz U an authorlzad 
coursa of study emphasizing criminal and civil ar:&*^- bi^ ^ preser^cly offered as 
an elective for students in grades seven throuah twalve. It funded by the 
Education Consolidation and Improvement Act (ECEA) , haptar lI ^ in the amount of 
$109*760* and Is currently taught In over thrmm^- Lhn Di/ le County's Junior 
and senior high schools, directly and indirecfci .i%r^>tm '»P:3roximataly 40,000 
students* 

LEG^ has been extensively evaluated every yeair si ic ) It.^ inception in 1976. 
Results of thesa evaluations indicated that the 4.iA: . q^ect had substantially 
achieved Its goals each school year in terms of chfe thy^m major projact goals, 
i# a* I 

1) expanding the LEGAL Project to non-user schools and classes, 

2) continuing and/or expanding support services to schools current Iv uslns 
LEGALi and J b 

3) reinforcing and expanding linkages with resource agencies and 
organisations functioning at the local, state, and national levels. 

More specifically, year by year examinations of LEGAL 's activity logs and 
analyses of data obtained from teacher and student surveys have consistently 
shown that the LEGM. Projact has expended considerable effort to increase the 
number of school administrators who were aware of the project, provided the 
appropriate instructional support services to LEGAL teachers and students • made 
available appropriate in-service training to all LEGAL teachers and maintained 
adequate Inventories of LEGAL curriculum products. Additionally, local, state 
and national organization maintained and/or enhanced their support for the LEGAL 
Project and project products and activities were favorably evaluated by LEG^ 
teachers, resource personnel and student participants. 

Description of the Evaluation 

Since all previous evaluations of the LEGAL Project had been extremely 
favorable, the Office of Educational Accountability (OEA) decided to greatly 
reduce the si^e and scope of the 19a4--85 evaluation. Rather than spend time 
exmining LEGAL documents and collecting and analyzing data gathered from 
schools which had been Involved with LEGAL for many years, OEA decided to 
concentrate its resources on evaluating the extent to which LEGAL achieved its 
primary goals in schools which had never before offered LEGAL courses* 
Consequently, OEA staff sent questionnaires to the ten social studies teachers 
in those schools which were offering LEGAL courses for the first time. In 
addition, OEA personnel mailed student questionnaires to savaral of the above 
mentioned teachers to collect a ten percent pupil sample from the approximately 
700 students who were enrolled in these "new" LEGAL courses during the fall 
semester. ^ 

In sum, this evaluation focuses on the extent to which new consumers of the 
LEGAL Project favorably viewed LEGAL 's support sarvices, In-servlca training, 
and curriculum. 
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Results 



The following saetion contains detailed findings of the evaluation of the 
1984-85 LEGAL Project. Initially presented are data which evaluate the appro- 
priateness of the instructional support services LEGAL personnel provided to 
LEGAL teachers and students. Following this, an evaluation of the availability 
of appropriate in-service training for LEGAL teachers is discussed* 



Provision of Instructional Support Services to LEGAL Teachers and Students 

To ascertain the extent to which the LEGAL staff provided appropriate instruc- 
tional support services to LEGAL teachers and students, an analysis of selected 
questionnaire items was made, ^ Results showed that 71% of all teecher-respon- 
dents were aware of LEGAL curriculum products, and 572 had requested LEGM. 
materials. Furthermore, 100% of those respondents who had asked for curriculum 
materials believed they had obtained "adequate" materials "always" or "most of 
the time"* Finally, 100% of the respondents thought materials were promptly 
delivered "always" or "most of the time". These results generally parallel 
those obtained in the previous (1982-83 and 1983-84) evaluations. 

Analyses of the LEGAL pupils* responses to selected Items on the student ques- 
tionnaire i^icated that 32% of the respondent.! thought the quality of materials 
used to support the instruction was better than that employed In other courses 
while 53% believed the quality of materials was about the same. Furthermore * 
49% of the respondents indicated that the quality of outside rmseurces used to 
support the instruction was better than the resources used In their other 
classes (40% felt the quality was about the sme) * These "approval ratings" are 
substantially lower than those given by consumers surveyed during the two 
previous LEGAL evaluations. It should be noted that the student participants 
involved in the earlier surveys were, for the most part, from the South and 
South Central areas (reflecting thm primary concentration of LEGAL courses at 
the time) whereas, the "new" participants sui^eyed for this evaluation reside 
primarily in the North and North Central Areas* Finally, a majority of LEGM. 
pupils who had come In direct contact with resource personnel (such as Judges, 
attorneys, etcO rated all resource personnel categories "good", giving 
especially high ratings to attorneys and police officers* These latter results 
are essentially the same as those obtained In the two preceding evaluations. 

Provision of In--service Training to Legal Teachers 

To determine the extent to which the LEGAL Project made available appropriate 
in-service training to the "new" teachers involved with LEGAL, selected ques- 
tionnaire items were analyzed to ascertain the quality of effort LEGAL employed 
to accomplish this task. EKamination of teacher responses to the survey Indi- 
cated that 71% of the responding teachers believed they had received adequate 
in-service training. Interestingly, 86% of the teachers who completed the 
questionnaires also stated that they would like more In-service training partic- 
ularly in the areas of utilizing media resources, conducting mock trials, and 
utilizing comiunity resources* Apparently, almost all of the LEGAL teachers who 
filled out this survey were eager to know more about LEGAL, despite the fact 
that almost three quarters thought the available In-service training was ade- 
quate* These results also parallel those obtained in the two previous 
evaluations* 
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Dlseussion/Recommendatlons 



^alysis of all data collected for tha 1984--85 LEGAL Project avaluatidn indi- 
cated that LEGM, has met Its goal of providing appropriate instructional support 
services to students of LEGAL course and appears to have achieved this same goal 
with Its "new" LEGAL teachers. Furthermore, LEGAL seems to have provided rele- 
vant in-service training to its "new teachers". Finally, as previously noted, 
it should be mentioned that the LEG^ Project is now disseminating more fully 
into some of the inner city areas and thus, is beginning to impact upon students 
whose enthusiasm for the project may differ qualitatively from its original 
consumers. 

Notwithstanding the generally favorable results of this study, the following 
recomendations are madei 

1, LEGAL Project staff should insure the provision of inservlce to new 
teachers regarding the areas of utilizing co^unity resources, eon- 
ducting mock trials, utilizing media resources, and developing in- 
structional strategies. More specifically, prior to each fall semes- 
ter, LEGAL personnel should CQntact staff in the Office of Educational 
Planning to obtain a complete list of all "new" LEGAL teachers. LEGAL 
staff should then personally invite all of these teachers to the 
various training sessions which LEGAL sponsors. 

2* LEGAL staff should maintain regular phone contact (for at least a year) 
with each year's "crop" gf "new" LEGAL teachers to help establish and 
maintain a strong coraunicative link between the project and the 
instructors who are new to the project* 
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D^E COUNTY PUBLIC SCHOOLS 
LEGAL TEACHERS* QUESTIONNAIRE 
OFFICE OF mUCATlONAL ACCOUNTABILITY 



DO NOT 
WRITE IN 
THIS GOLmm 



h 2 

1. How many years have you worked as a teacher? 3-4 

2* How many semastars have you taught LEGAL? 5_g 

3* What grade lavalCs) do you teach? 7 

4, In your Qpinlons is the LEG^ dourae worthwhile? 100% yes no 8 

1 " 2 

5, Would you like to teach LEGAL next year? 86% yes 141 no 9 

r 2 

6, How would you rata the interest level of your students regarding the 
LEG.^^ course? 



^ 43% high 43% medium 14% low 

1 ^ ^ 3 

Indicaca^ the extent to which you feel that each of the potential bene- 
fits of exposure to LEGAL, listed beloWj are characteristically attain- 
ed by your students by selecting appropriate numbers from the rating 
scale below, and placing them to the left of each potential benefit. 



RATm SCALE 
1 — attained by most 







\ 


2 
3 


(57%) 


1 


(43%) 


2 


(86%) 


2 


(14%) 


3 


(86%) 


1 


(14%) 


2 


(57%) 


1 


(43%) 


7 


(86%) 


2 


(14%) 


.3 


(14%) 


1 


(86%) 


2 


(71%) 


1 


(29%) 


2 
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learning facts about the law H 

learning to analyze situations or solve problems 12 

developing a positive attitude toward the law 13 

acquiring infomation regarding law-related careers 14 

learning to think critically j 

learning to work cooperatively with others 16 

developing an awareness that the legal system is 

not flawless • I7 

other (write in) 1 Ig 
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LEGAL Teachers' Questionnaire (continued) 



8. Check any of the folloving resource personnel who were utilised in your 
LEGAL class and rate the ef f activeneas of their resource presentation 
by placing a check (x) in the appropriate column to the right of each 
personnel category. 





personnel 


^ood 

T 


talr 
2 


■J 


joor 
3 






fudges 


n 


0 




0 


19 




attorneys 


W / /to 


35% 




0 


20 




police officers 


lOOZ 


50% 




0 


21 




consumer law 
representatives 


50% 


50% 




p 


22 




others Cspecify) : 










23 




social worker 




100% 










law student 


100% 










a 
^ • 


Did you receive adequate 


inservlca 


training regarding LEGAL? 










71% 


yes 


29% no 


24 


10. 


Do you know what curriculum product 
flee? 


1 

s are availablQ f 


rom 


2 

the LEGAL of- 










71% 


yes 


29% no 


25 



11* Did you ever request materials from the LEGAL Office? 

571 yes 43% no 26 

If yes I 

a. Were you able to obtain adequate materials from the LEGAL Office? 
(check one) i 



33% always sometimes 

67% most of the time never or almost uever 

b. Were the materials you ordered promptly delivered? (check one) s 
831 always ____ sometimes 

17% most of the time never or almost never 



27 



28 



12. This school year, were any of your students involved in the Law Related 

Field Study ProgrMi ? — — ~ 

57% yes 43% no 29 

,: ,= 11 \ ' 
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LEGAL Teachers* Questionnaire (continued) 3^ 

12. (Rei Law Related Field Study Program) 
If yes I 

a. How many students were involved? x - 25 30-33 

bp Do you feel the program was worthwhile? (100%) yes no 34 

1 ~2 ' 

c. Please answer the following questions on the line provided by 

writing the one number from the scale below that most accurately 

describes your feelings* 

strongly strongly 
disagree disagree undecided agree agree 

1 2 3 4 5 

(100%) 4 I believe the Law Related Field Study Program*s materials 35 
(i.e*, the field study modules) were satisfactory* 



(50%) 4 


(50%) J 


(50%) 4 


(50%) 5 
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36 



no 42 



— — ^wu^ ^^^^ ^jwiittiitfciA J. xxoswiUi 

organizations was adequate. 

I feel the coordination supplied by the LEGM, Project 37 
staff was sufficient* 

I believe the overall value of the Law Related Field Study ' 38 
Program is worth the effort involed* 

13, This school year^ were any of your students Involved in the Mock Trial 
Program ? ^ — 

29% yes 71% no 39 
If yes I . ~ 

a* How many students were involved? X - 20^5 40-41 

b. Do you feel the program was worthwhile? 1Q0% yas 

1 

c. Please answer the following questions on the line provided by 
writing the one number from the scale below thmt most accurately 
describes your feelings* 

strongly strongly 
disagree disagree undecided agree agree' 

1 2 3 4 5 

(50%) 3 (50%) 4 I believe the training I experienced to institute a mock 
trial was sufficient- 

(100%) 3 I think the support materials I received regarding the Mock 
Trial Program were adequate, 

(50%) 3 a50%) 4 I feel the sewices provided by the mock trial competition 
coordinator (i*e*, the University of Miami Law School) were 
satisfactory. 

(50%) 3 (50%) 4 I believe the aaaistance T obtained from the LEGAL Project 
staff was adequate to support the Mock Trial Program, 



43 



44 



45 
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LEGAL Taachers* QuestioLuiaire (continued) 4^ 

14. This school year, were any of your students involved in the Community 
Law Proiect Program ? (senior high school) ^ 

yes 100% no 47 
1 2 

If yes I 

a» How many students were involved? 



b. Do you fael the program was worthwhile? 

yes no 

1 "2 

c. At your school was the Community Law program (check one)* 

community based? 

1 

^ school based? 

2 

both? 

3 

Please answer the following questions (regarding the Connnunity Law 
Project) on the line provided by writing one number from the scale 
below that most accurately describes your feelings* 

strongly 

disagree disagree undecided 

1 2 3 

, I believe the support that I received from Cormunity Resource 53 

agencies was sufficient, 

I think the students^ abilities to conduct independent re- 54 
search have generally improved* 

I feel the LEGAL Project materials (e,g, , the Community Law 55 

Source Book and the f ilmstrlp) for this program were satis- 
factory, 

__ L believe the support which I obtained from the LEGAL Project 56 
staff was adequate. 



48-50 
51 



strongly 
agree agree 
4 5 
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LEGAL Teachers' Questionnaire (continued) 



15, Would you like additional inservice training? (check one): 



86% yes 141 no 57 
1 2 

If yes j in what areas? (check as many as apply) 

17% selecting materiala 58 

33% utilizing coMnunity resources 59 

0 conducting law--related field experiences 60 

17% constructing of evaluative Instruments 61 

50% conducting a mock trial 62 

17% conducting moral dilemmas 63 

67% utilizing media resources 64 

0 conducting a community law project (senior 65 
high) 

17% infusing LEGAL into other social studies 66 
courses 

0 conducting liigal research (senior high) 67 

0 working with Court Observer Program 68 
_ (senior high) 

17% developing instructional strategies 69 

0 other (describe briefly) 70 
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Appendix B 

LEGAL Project Student Quastlonnaire and Results 
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DADE COUNTY PUBLIC SCHOOLS 
OFFICE OF EDUCATIONAL ACCOUNTABILITY 
LEGAL PROJECT 
STUDENT QUESTIONNAIRE 



School Name* 



Dear Studanti 

As part of an avaluation of the LEGM. Project, we are surveying a number 
of students to determine how they liked their LEGAL course as compared to 
Qther courses and what they think they laarned from their exposure to 
this course. 

Please take a few minutes to respond to this questionnaire* After you have 
finished, place it in the envelope which has been provided, seal the enve- 
lope and return it to your teacher. In order to insure the confidentiality 
of your responses 4 we ask you not to write your name on the questionnaire. 

Thank you for your time. 

Sincerely, _ 



Norman Proller, Evaluation Specialist 
Office of Educational Accountability 



grade 


level 


(check one) 




0% 


6 


47. 9Z 


9 


11,3% 


7 


7.0% 


10 


12,7% 


8 


18*3% 


11 






2,8% 


12 



In your opinion, how would you rate the LEGAL course compared to your 
other courses? (check one) 

43« 1% better than most 47. 9% about the same 7,0% worse than most 



3, How would you rate your interest in the LEGAL course? 

43* 7% high 53,5% average 2.8% low 

4, Did you get out of the LEGAL course what you expected to get out of 
it? . 

88.0% yes J2.0% no 
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DADE COUNTY PUBLIC SCHOOLS 
OFFICE OF EDUCATIONAL ACCOUNTABILITY 
LEGAL PROJECT 
STUDENT QUESTIONNAIRE 



5. What did you get out of the LEGAL Murse? (check all thosa that app 
97* 2% a* I learned facts about the law* 

I learned to analyze situations and solve problems. 



76, 


.5% 


71. 


8% 


15* 


5% 


50, 


7% 


50, 


7% 


57, 


7% 


57* 


7% 


40. 


8% 


-1- 


k. 




1* 



Less * 



Place a check ( ) before all of the following legal professionals with 
whom you had contact during your LEGAL course. Than rate the quality 
of each professional's instruction and/or assiatance by placing a check 
< ) on the appropriata line to the right of each relevant professional* 



Check if you had contact with: 
Legal Professionals 

judges 
attorneys 

police officers 
._. consumer law representatives 

other (specify) social workers 

la w students 



Quality of Instruction 
good average bad 
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DO NOT 

WRITE IN 
THIS COLUMN 



9 
10 
11 
12 
13 
14 
15 
16 
17 

18 - 20 



50% 


30% 


20% 


21 


63% 


33% 


4% 


22 


65% 


29% 


6% 


23 


30% 


40% 


30% 


24 


24% 


48% 


28% 


25 


48% 


48% 


4% 


26 



DADE COUNTY PUBLIC SCHOOLS DO NOT 

OFFICE OF EDUCATIONAL ACCOUNTABILITY WRITE IN 

LEGAL PROJECT THIS COLUMN 
STUDENT QUESTIONNAIRE 



7. In yDur opinions how would you 
rate the LEGAL course (relativa 
to your other courses) in terms 
of I [Place a check ( ) in only 
one box located to the right of 
all the following statemants , ] 



better 
than 

my other 

courses 



about the 
same as 
my other 
courses 



worse 
than my 
other 
courses 



a* 


how interesting the LEC3AL course 
was 


52% 


43% 


5% 


27 


b. 


the enthusiasm of the LEGAL teacher 


55% 


33% 


12% 


28 


c. 


the organization of the LEGAL 
course 


281 


59% 


13% 


29 


d. 


the relevance of the LEGAL course 
to the '■real_ T7orld" 


66% 


25% 


9% 


30 




the quality of materials (e.g* 
audiovisual etc*) used to 
support the LEGAL instruetion 


32% 


53% 


15% 


31 




the quality of outside resources 
used t© support the LEGAL instruct- 
tion (field trips ^ speakers brought 
into the classroom, etc.) 


49% 


40% 


11% 


32 



Did you take part in any of the following programs? (check all those 
that apply) • 

27% Law Related Field Study Program 

61% Mock Trial Program 

7% Community Law Projects Program 

If you were Involved with any of these programs what were their 

good points? ____ 



33 
34 
35 



36 - 39 
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D^E COUNTY PUBLIC SCHOOLS DO NOT 

OFFICE OF EDUCATIONAL ACCOUNTABILITY WRITE IN 

LEGAL PROJECT THIS QOLUm 
STUDENT QUESTIONNAIRE 



8, (continued) 

What ware thalr bad points? 



40 - 43 



9. If you CQul^do it again^ would you take a LEGAL course? 

80% yes 20% no 44 



OEAi 5/3/85 

EVAL,JM 84-85 Legal 
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The School Board of Dade County, Florida adheres to a policy of 
nondiscrimination In educational programi/ictivitl^ and employment 
and strives affirmatively to provide equal opportunity for all as required 
by: 

Title VI of the Civil Rights Act of 1964 - prohibitt discrimination 
on the basis of race, colof, religion, or national origin. 

Title VII of the CIvi! Rights Act of 1964, as amended - prohibits 
diicriminatlon in employment on the basis of race, color, religion, 
sex, or national origin. 

Title IX of the Education Amendmente of 1972 - prohibits 
discrimination on the basis of sex. 

Age Discrimination ^ Act of 1967, as amended - prohibit 
discrimination on the basis of age between 40 and 70, 

Section 504 of the Rehabilitation Act of 1973 » prohibits 
discrimination against the handicapped. 

Veterans are provided re-employment rights in accordance with PX. 
93-508 {Federal and Florida State Law, Chipttr 77422, which also 
stipyjates categorical preference for employmsnt. 
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